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Abstract. I am not a historian; these are just reminiscences of a person involved in the development of 
optimization theory and methods in the former USSR. I realize that my point of view may be very personal; 
however, I am trying to present as broad and unbiased picture as I can. 


1. Mathematics in the USSR 

Let me start with a few words about the general situation in mathematics and natural 
science in the USSR. For a younger reader who lives nowadays in a completely different 
environment, these remarks are worth reading, since today it is really hard to imagine the 
rather specific life conditions in that country in the 1950-60s. There was a communist 
totalitarian system with a very poor population and an obsolete industry. No human rights 
were respected, no basic liberties like freedom of speech were available. Nevertheless, 
certain branches of science (such as mathematics) were flourishing, and, in some areas, 
the achievements in research were comparable or even exceeded those of the rest of the 
world. What were the reasons for such a success? 

First, there was strong government support for research in such fields as physics 
and mathematics. This can be explained mainly as motivated by military reasons. The 
authorities were convinced that success in atomic bomb construction, the space compe¬ 
tition, etc., can be achieved via the development of the underlying scientific disciplines. 
Flence, fundamental research was supported as well as applied studies. Mathematicians 
and physicists basically had no problems with funding. There were many research in¬ 
stitutions not related to education, where the employees could concentrate on purely 
theoretical studies, with minor limitations on the duration of the research and having 
no strict obligations on the results obtained. Such freedom of research, in combination 
with tenure positions for scientists of all levels, sometimes led to outstanding results. 

Second, there were good traditions in teaching mathematics. Often, the level of 
mathematical education in Soviet high schools was superior to that of the USA. More¬ 
over, for talented middle- and high-school students, there was a specific system of 
mathematical training based on mathematical circles supervised by University students 
and professors. Every year, mathematical olympiads of various levels were organized. 
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I always recall one such circle (within Moscow State University) and the Moscow math¬ 
ematical olympiads with delight; they shaped my professional future. Mathematical 
departments at some Universities were highly remarkable. For instance, at the math¬ 
ematics department of Moscow State University in the 1960s, the concentration of 
outstanding mathematicians of the XX-th century had no analogs in the rest of the world 
(A. Kolmogorov, I. Gelfand, L. Pontryagin, P. Aleksandrov, A. Tikhonov, L. Ljusternik, 
V. Arnold, Yu. Manin, S. Novikov, Ya. Sinai, R. Dobrushin and many others). There was 
a system of seminars chaired by such scientists, and many students participated in these 
seminars from their undergraduate years. It was an exceptional opportunity to contact 
such legendary figures and to be involved in research at the early stages. 

Third, tuition at universities was free, and in principle, a student of modest means 
from a provincial town was admitted to learn at the best, Moscow University, provided 
he/she passed the entrance examinations. Textbooks and monographs were extremely 
cheap and were published in a large number of copies. For instance, the price of the text¬ 
book “Mathematical Programming” by V. Karmanov was 44 kopecks (about 70 cents), 
and just for one edition the circulation was 60,000 copies; the price of a popular-science 
book “Stories on Maxima and Minima” by V. Tikhomirov was 35 kopecks with a circu¬ 
lation of 160,000 copies [1,2]. 

One more reason: there was a deficiency of career opportunities for ambitious 
young people. Recall that there were no such professions as a businessman, a manager, 
a banker, or a programmer. It was impossible to pursue the career of a politician, a judge 
or a diplomat without being a member of the Communist party. Moreover, there was no 
hope to perform any honest research in most humanitarian sciences, which were strongly 
politicized and filled with Marxist terminology. Thus the career of a mathematician was 
one of the few ones free of ideological pressure. 

However, this idyllic picture had a dark side. “The iron curtain” was not only 
a metaphor, it was a real obstacle to international contacts. Academician N.N. Lusin 
was exposed to a humiliating execution after the publication of his papers in Western 
journals in 1936 [3]. When Professor Ya.Z. Tsypkin received a letter in the late 1940s 
from an American reader of his paper, he was summoned by the KGB and underwent 
a long investigation there, tottering at the edge of arrest. Of course, the situation in the 
1950-60s was not that dramatic, but lots of difficulties still remained. Even if a scientist 
was invited to a conference abroad, with full coverage of his expenses, this did not mean 
anything. First, there was the “black list” of scientists who were not allowed to go abroad 
under any circumstances. The reason could be his dissident activity (e.g., he had signed 
a protest against putting the mathematician A. Esenin-Volpin into a psychiatric clinic 
by force, see [4] for details related to this letter), or his ethnic origin, or unsanctioned 
contacts with foreigners. But even if he was not on this list, he would be obliged to 
pass a long and humiliating procedure with no guarantee of success. He should have 
got a recommendation from his local party committee and a director of the University 
(“kharakteristika”), then the candidature must have been approved by the special “exit 
commission” of the regional party committee, next, KGB permission was required, 
and finally he should have passed a review by the Central Party Committee of the 
USSR. Let me tell you a funny story about my own experience as an illustration. I was 
on the “black list” and had no chance to travel abroad. However, in 1976 I made an 
attempt. It was on the occasion of the 9th International Symposium on Mathematical 
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Programming in Budapest, and I was invited to present a plenary talk. Luckily, I got 
permission (maybe it was easier, because Hungary was in the East block). While visiting 
the mountains before the trip, I unfortunately broke my leg. But the desire to go was 
so strong that I was ready to travel in spite of the medical problems. Thus I arrived to 
my last appointment to get the final instructions and my passport. However, the vigilant 
official looked at my crutches and said: “Provide me a permission from your doctor 
that you can go abroad.” Well, I got it and delivered it to the bureaucrat. “No, I refuse 
you,” he declared. “Why?” I whispered. “What an impression will foreign scientists get 
when observing you? That the Soviet science stands on crutches.” And I had to stay in 
Moscow... 

But visits abroad were not the only side of scientific life which heavily depended 
on the authorities’ decisions. Promotion, defense of a candidate or doctoral dissertation, 
elections to the Academy of Sciences, getting various awards, - everything was under 
the party control, and there was no chance to advance without an approval. In many 
cases, the lack of such an approval was explained not by individual or professional 
qualities, but by the data in the personal “anketa” (when hired, everybody must have 
filled in a detailed standard questionnaire or “anketa”). For instance, famous was “the 
fifth point” (item number five in the questionnaire) about your ethnic origins. If you 
were unlucky enough to be a Jew, your career opportunities were greatly restricted. 
Of course, I am unable to highlight this important theme in full detail; the interested 
reader can find more information in [5-7]. And many brilliant scientists, in particular in 
the field of mathematical programming, were forced to emigrate due to these insulting 
restrictions. 

Another source of difficulties for researchers was the mania for secrecy. Nobody was 
allowed to publish any paper without special permission confirming that the publication 
does not contradict numerous security restrictions. All letters abroad (as well as letters 
from abroad) were opened and inspected. Everybody must have special permission, 
and a full text of the talk had to be approved if you were going to an international 
conference. And working in a classified institution (which was the case for many experts 
in mathematical programming), complicated the situation drastically. 

The list of misfortunes of Soviet science looks too long... to finish, let me mention 
the last (but probably not the least) trouble. Most branches of science had a strongly 
hierarchical structure. There was “a big boss” who completely controlled all principal 
decisions (visits abroad, elections, awards, high level promotions, etc.). For instance, 
such a boss in numerical analysis was academician A.N. Tikhonov. Next, there were 
“local bosses” who made decisions on the local level (low level promotions, defense of 
candidate dissertations and so on). Luckily, there was no strong monopolization in the 
field of mathematical programming. Maybe the lack of a single all-powerful leader made 
Soviet mathematical programming more competitive and led to significant progress in 
this field. 

Needless to say, all above-mentioned restrictions and misfortunes had their own 
dynamics. The situation in the 1940s to mid-1950s was the worst. Malevolent intent 
by the authorities could lead a researcher to the GULAG. The period 1955-1970 was 
the least oppressive, it was a “golden age” of Soviet mathematics [8] and it was the 
best time for mathematical programming as well. The years 1970 to 1985 were a period 
of stagnation in political, social, economic, and scientific life. All the troubles I have 
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mentioned above played a more and more significant role in the development of Soviet 
science and thus led to its degradation. 

Now, after these introductory remarks oriented towards a Western or a young reader 
(Russian readers of my generation are too familiar with all the peculiarities of the former 
Soviet scientific life and could contribute a lot to my exposition based on their personal 
experience), we can turn to the historical perspective of the development of mathematical 
programming in the USSR. The roots of this development lie in the previous centuries, 
and we can repeat after Newton: “We stand on the shoulders of giants.” 


2. Prehistory 

The first scientist who dealt with optimization in Russia was a true giant. 

L. Euler, 1707-1783, lived in Russia in 1727-1741 and 1766-1783 (more then 30 years 
in total), and published about 850 papers and books. His biography and a description 
of his works can be found in [9]. Euler recognized the role of optimization problems; 
he wrote: “Whatever happens in the world, within can be observed the meaning of 
maximum or minimum; hence there is no doubt that all phenomena in nature can be 
explained via the maximum and minimum method...” , see [10], Appendix 1. He made 
important contributions to various fields of the theory and methods of optimization. 
First, he obtained higher order necessary and sufficient conditions of optimality for 
unconstrained optimization. Second, he was one of the founders of the calculus of 
variations. In this direction, he obtained a number of fundamental results such as 
a necessary condition for an extremum (referred to as the Euler equation today). Next, 
he applied discrete approximations to solving the problems of calculus of variations; 
this can be thought of as the first numerical method for optimization problems. Finally, 
Euler considered isoperimetric problems in the calculus of variations, treating them in 
a very broad sense; this can be viewed as the first studies in constrained optimization. 

In the XlX-th century, a non-formal follower of Euler’s research was one of the 
outstanding Russian mathematicians. 


P.L. Chebyshev, 1821-1894. In the field of optimization, he introduced what is now 
known as Chebyshev approximation. In the simplest form, it is the problem of finding 


min max 

x teT 


a it ) - 5>/i(0 
i 


We can say today that this is an example of a convex nonsmooth optimization prob¬ 
lem, or, more specifically, semiinfinite programming. Chebyshev had found an analytic 
solution to some particular cases (for a(t) = 1, ff t) = t‘,T = [0, 1], the solution 
is the Chebyshev polynomial) and provided a general characterization of the optimal 
approximation. He also studied many other optimization problems; some of them were 
of a practical origin (such as the least distorted geographic maps, the optimal cut out 
of clothes, the best choice of the parameters of mechanical devices for plotting curves). 
Like Euler, Chebyshev did understand the significance and diversity of extremum prob¬ 
lems. For instance, he claimed: “... the same problem is common to all practical activity 
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of human beings: How to allocate our resources so as to achieve as high a profit as 
possible? Solution of such problems constitutes the subject of the so-called theory of 
maximum and minimum quantities. These problems, being of a purely practical origin, 
have a specific significance for the theory as well: all laws governing the movement 
of weighted or weightless matter are solutions of problems of this sort. We must not 
overlook their fruitful influence on the development of mathematical sciences.” 

Two great Chebyshev’s followers continued his research of extremum problems. 


A.A. Markov, 1856-1922, is well known for his works in number theory and proba¬ 
bility theory ( Markov chains, Markov processes). He also contributed to some areas of 
optimization. For example, he considered the so-called problem of moments: 

b 

min / t n f(t)dt, 

a 

b 

0<m<L, J t‘fm = Ci, i-l . n-l. 

a 


This is a nonstandard constrained optimization problem with integral functionals (in¬ 
volving no derivatives in contrast to the calculus of variations). He also established the 
Markov inequality, which is a solution of the following problem: 


max max 

PO)en a<x<b 


P'(x) 


|,P(x)| < M, a < x < b, 
where n is the set of all polynomials of degree at most n. 


A.M. Lyapunov, 1857-1918. At first glance, his works were not related to optimization. 
However, this is not exactly the case. Lyapunov developed stability theory for ordinary 
differential equations; in its simplest form it states that a solution x{t) of the equation 

x = f{x) 

is stable if there exists a function V(x) (the Lyapunov function) such that 

(wu), /(x)) < 0. 

We can take a reverse point of view: The differential equation above is a continuous-time 
method for minimizing V(x). Thus the method provides a systematic tool for validation 
of the convergence of numerical methods of optimization. 


3. The pioneer 

L.V. Kantorovich, 1912-1986. He graduated from Leningrad University at the age of 
18 and became Full Professor at 22; his first paper was published when he was 16. 
He was granted an unusual combination of awards including the Stalin Prize (1949), 
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Lenin Prize (1965) and the Nobel Prize (1975). The biographical data on Kantorovich, 
including his autobiography My Journey in Science , can be found in the volume [13] 
published in English, see also [14-16]. Kantorovich made significant contributions to 
numerous areas of functional analysis; he was one of the founders of numerical analysis 
in our country; he was one of the first who recognized computer science as a new 
branch of mathematics. However, for the mathematical programming community, he is 
undoubtedly the father of a new science OPTIMIZATION , which includes the standard 
mathematical programming. He was responsible for the following three breakthroughs 
in optimization: 

• Linear programming, 1939; 

• General conditions of optimality, 1940; 

• Functional analysis techniques, 1939-1948. 

Let us consider briefly each of these. 


3.1. Linear programming 

In 1939, L.V. Kantorovich published a small book (just 67 pages) [17], where a new 
type of optimization problem was addressed. It was not in the standard form of linear 
programming, but used a number of variations. Much later, in [20], Kantorovich stated 
that the model considered in the Western literature was a particular case of his model; the 
equivalence of all these formulations of a linear programming problem was not clearly 
understood at that time. The appearance of this book was stimulated by the questions 
of engineers and economists and was not based on any previous mathematical studies 
of the author or other mathematicians. Many practical applications were indicated in 
the book; also, ideas of numerical methods based on dual variables (called “resolving 
factors”) were given. 

However, this revolutionary book had little response from economists or mathemati¬ 
cians! There were several reasons for such disregard. First, there was no true demand for 
mathematical methods in the totalitarian system of the Soviet Union. Contrary to the first 
phrase in [20] “Planning of national economy or its individual branches on the scale of 
the state is only possible under the condition that the private (capitalist) ownership of the 
means of production is replaced with the peoples’ (socialist) ownership," the socialist 
system was based on voluntary, administrative methods. The ideas of “higher rational¬ 
ity” (i.e., what was favorable to the leaders of the country at the moment) prevailed 
over common sense and rational reasonings (see Sect. 5.1.7 below). Second, the book 
was not written as a mathematical text, that is why mathematicians paid no attention 
to it. It was just a collection of examples, word explanations and simple calculations. 
The first rigorous mathematical paper on the general linear programming problem was 
published by Kantorovich only in 1957. His second book on linear programming [20] 
was published in 1961. It contained two mathematical appendices (written in collabora¬ 
tion with G. Rubinstein) where a mathematical formulation of linear programming and 
numerical methods for its solution were given; however, the main effort was directed 
to the provision of compatibility with the Marxist dogma. For instance, dual variables 
were referred to as “objective-conditionedestimates” (“o.o.o.” in Russian) rather than 
“prices.” 
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3.2. General conditions of optimality 

In [18], Kantorovich considered a very general constrained optimization problem in 
a topological space: 

min fix). 
xeQ 

Here, fix) is a differentiable functional in a topological space X, Q C X is a set which 
yields a convex cone approximation K at a point x* e Q. He obtained the following 
necessary condition for extremum. 

Theorem. If x* is the minimum point, then fix*) e K*. 

In the theorem, fix) denotes the gradient of fix), while K* is the cone conjugate 
to K. Surprisingly, this brilliant mathematical paper also caused no response! Probably 
because it was, in fact, ahead of its time. 


3.3. Functional analysis techniques 

The first paper on the convergence of an iterative method for minimization of a quadratic 
functional was published by Kantorovich in 1939. Later (1944, 1945, 1947), he con¬ 
tinued this research. The results were summarized in the large paper [19], which was 
published in 1948 in the leading Soviet mathematical journal Russian Mathematical Sur¬ 
veys. Among many other results related to numerical analysis, it contained the proofs of 
convergence (and estimates of the rate of convergence) of the steepest descent method 
for a quadratic functional and Newton’s method for functional equations. Besides these 
practical results, the paper demonstrated successful applications of functional analysis 
techniques to optimization problems. Concluding, this work established a high level of 
standards for the validation of numerical methods in optimization. 


4. Fifties: emerging a new science 

By the 1950s, a number of research directions in the field of extremum problems had 
appeared. 

Several works dealt with linear inequalities, Chebyshev approximations to incon¬ 
sistent linear equations and related topics. S.N. Chernikov studied the theory of linear 
inequalities (“the principle of bounding solutions” which describes the vertices of the 
solution set). Two scientists from the Ukraine, E.Ya. Remez and S.I. Zukhovitskii 
proposed finite methods for finding the best Chebyshev approximation', actually, these 
methods were simplex-like algorithms for solving the corresponding linear program¬ 
ming problems (primal or dual). This research is summarized in the monographs [21-23] 
published much later than the original works. For instance, the first book (in Ukrainian) 
on numerical methods for Chebyshev approximations was written in 1935. 

At the same time, significant progress was achieved in optimization problems related 
to Markov’s problem of moments, due to the scientific schools of N.I. Akhiezer and 
M.G. Krein [24,25]. 
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Simultaneously intensive research was initiated in the field of linear programming. 
G.Sh. Rubinstein, a former student of L. Kantorovich published the first rigorous math¬ 
ematical formulation of linear programming problems and their analysis in Russian in 
1955 [26]. The results of Western scientists (G. Dantzig, H. Kuhn, A. Tucker, D. Gale, 
and others) on linear programming had became known in the Soviet Union. An import¬ 
ant role in this process was played by translations of the original works into Russian; the 
first one was [27]. Russian textbooks on linear programming and related topics appeared. 
The first publications on matrix games were by N.N. Vorobjev and E.S. Ventzel [29], 
while the first Russian textbook on linear programming was written by D.B. Yudin and 
E.G. Golstein [28]. 

Important events happened in the field of automatic control. In 1956, L.S. Pontryagin 
and his coauthors provided a new formulation of the optimal control problem and 
obtained a new necessary condition for optimality, the so-called maximum principle. It 
was a far-reaching extension of results in the calculus of variations [30]. 

As the reader can conclude, it was a time of intensive activity. However, the results 
obtained were isolated and were not understood as being parts of a unified scientific 
discipline. Are there any links between linear programming and optimal control, be¬ 
tween the problem of moments and Chebyshev approximations,and between numerical 
methods for unconstrained optimization and those for solving linear inequalities? In the 
1950s, the typical answer was negative. 


5. The sixties: golden age 

The situation had changed dramatically by the early 1960s. The time was ripe; all parts 
of the puzzle were ready to deliver a beautiful overall picture, resulting in an immediate 
kaleidoscope of new contributions. 


5.1. Main research directions 

5.1.1. The general theory of extremum problems. The understanding of the common 
nature of various optimization problems was the first breakthrough of the period. In the 
paper [18] by Kantorovich, the first general framework for the analysis of extremum 
problems was formulated; however it provided no technique for the specification of 
general conditions of extremum for particular problems. The Dubovitskii-Miljutin for¬ 
malism [31] succeeded in this direction: a theorem on the conjugate cone for an inter¬ 
section of several cones was an efficient tool for formulating necessary conditions of 
the extremum in a unified manner. This approach was well suited for a broad class of 
optimization problems mentioned above, such as linear programming, optimal control, 
approximation theory and many others. Moreover, it provided new optimality conditions 
for some hard problems (for instance, optimal control subject to phase constraints). The 
technique became very popular among Soviet researchers; the book [33] by I. Girsanov 
played a significant role in this popularization. Later, V. Boltyanskii [32] extended the 
approach and called it the method of tents. 

Another approach, developed by B. Pshenichnyj in the mid-sixties (and summarized 
in his books [34,35]), was based on the methods of convex analysis. It also exploited 
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the tools of functional analysis for obtaining necessary and sufficient conditions of 
optimality. The fundamental monograph by A. Ioffe and V. Tikhomirov continued this 
line of research [37]. Similar studies in the West were carried out by R.T. Rockafellar, 
L. Neustadt, H. Halkin, L. Berkovitz, J. Varga and others. 

General duality theory for convex optimization problems was developed by E. Gol- 
stein [36]. 

5.1.2. Numerical methods for general extremum problems. In parallel with the de¬ 
velopment of the general theory of extremum problems it was realized that the nu¬ 
merical methods for solving them can also be treated in a unified framework. The 
publications [38,39] introduced numerous gradient-like methods for unconstrained op¬ 
timization and their extensions to constrained optimization such as gradient projection, 
conditional gradient, constrained Newton, cutting plane, penalty function methods and 
some others. The general theorems on convergence and the rate of convergence of such 
methods in finite and infinite dimensional problems were proved; numerous applica¬ 
tions (to standard mathematical programming problems, optimal control, semiinfinite 
programming, etc.) were considered. This line of research remained very active for some 
time, e.g., see the monographs [40-42]. 

5.1.3. Nonsmooth optimization. Traditionally, optimization methods dealt with differ¬ 
entiable functions and were based on gradient approximation. N. Shor was the first 
who extended the approach to nonsmooth convex optimization. In his Ph.D. thesis 
(1964), he proposed a subgradient method for nondifferentiable functions and applied 
this approach to numerical solution of a program dual to a transportation-like problem 
of linear programming. Later, this approach was extended and validated by N. Shor, 
Yu. Ermoliev, and B. Polyak [44-46]. The monograph [47] summarizes these studies; 
see also, [43]. 

A different method, the so-called center of gravity method was proposed by A. Le¬ 
vin [48] (and independently by Newman in the USA). Later it was proved to be optimal, 
with respect to the order, amongst all the methods of nonsmooth convex optimization 
which exploit only the values of the subgradient; however, it included the operation of 
finding the center of gravity of a polytope, which is hard to perform. 

Numerous methods have been developed for particular classes of nonsmooth opti¬ 
mization, primarily for minimax problems, by V. Demyanov [49,50]. 

5.1.4. Stochastic optimization. In many cases, the values of functions and their gradi¬ 
ents are corrupted by random noise. Effective minimization methods should be modified 
to retain convergence in such situations. This can be done via averaging or by step reg¬ 
ulation in iterative methods similar to the approach used by stochastic approximation 
methods in statistics. Such a revision of minimization methods under random noise 
was undertaken by Yu. Ermoliev [51]. Numerous applications of iterative stochastic 
algorithms to the problems of identification, estimation, pattern recognition, etc., can be 
found in the book by Ya. Tsypkin [52], 

Sometimes randomness is artificially incorporated in the minimization process, as 
for example in random search methods. An active proponent of such methods was 
L. Rastrigin [53]. 




10 


B.T. Polyak 


There was not that much activity in the area of stochastic programming (in the sense 
this term is understood in the Western literature); however a textbook was written by 

D. Yudin [54], 

5.1.5. Linear programming and related topics. After a long pause, investigations in 
this area resumed in the USSR. They were focused on the development of software for 
implementations of the simplex method and its variations (I. Romanovskii, U. Maikov, 
K. Kim, A. Cherkasski, V. Skokov, A. Stanevichus and others), numerical methods for 
special classes of linear programming problems ( transportation problems, decompos¬ 
ition methods, Chebyshev approximations ) [55], and iterative methods for linear pro¬ 
gramming [56-58]. The fate of the paper [56] was especially interesting. I. Dikin was 
a student of Kantorovich, and in his Ph.D. thesis he formulated rigorously some heuristic 
rules which his supervisor suggested for the numerical solution of linear programming 
problems. Dikin proved the convergence of the iterative algorithm, but failed to estimate 
its rate of convergence. The paper (similarly to the earlier works of Kantorovich, see 
above) attracted no attention and had been forgotten till the late 1980s, when it was 
recognized that the implemented version of the famous Karmarkar algorithm [65] was 
very close to Dikin’s original method. 

5.1.6. Discrete optimization. In Russian, the first monograph on discrete programming 
was published in 1969 [59]. The efforts of researchers in this field (Yu. Finkelstein, 
A. Korbut, A. Fridman, E. Levner, I. Sigal, I. Sergienko, V. Emelichev, A. Karzanov, 

E. Dinits, S. Lebedev and others) were mostly directed towards the solution of a special 
classes of combinatorial problems. 

5.1.7. Applications. In the early 1960s there were very optimistic beliefs about the 
practical applications of the ideas of optimal planning to the socialist economy and 
society. Many mathematicians were convinced that optimal plans and prices can be 
calculated using linear programming models. However, real-life attempts to implement 
this approach had failed. Many stories on the subject can be found in [16]. Here is just 
one of them. Exploiting Kantorovich’s work on the optimal cutting of a rectangular sheet 
into pieces of a given shape, engineers and economists of a factory that manufactured 
steel items were able to increase considerably the output production. However, they 
faced quite unexpected obstacles. First, as an outcome, the plan for the next year had 
to be increased correspondingly (for the socialist planning system, it was customary 
to require some extension of production automatically each year), but now the factory 
had no reserves to fulfill the expanded future plan. Second, each enterprise had a plan 
for collecting scrap. Obviously, due to the optimal cutting strategy, the amount of 
unused steel decreased, and thus this plan was violated. As a result, top managers of the 
factory were very upset (they were reprimanded by the Communist party officials) and 
consequently they refused to collaborate with mathematicians in future. 

Much later, Kantorovich organized a special commission under his guidance to 
investigate the situation with respect to applications of optimization models to the 
Soviet economy. The main goal was to find examples of successful applications and to 
extend the experience to other branches of production and service. After considerable 
investigation, the commission recognized the complete lack of such positive experiences. 
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5.2. Main scientific centers 

In contrast to the vast collection of research communities in the USA, where it is spread 
over many universities and some government and industrial research institutes, the 
mathematical programming studies in the USSR were concentrated in a few scientific 
centers: 

Moscow: Moscow State University (I. Girsanov, V. Tikhomirov, B . Polyak, F. Vasi- 

liev), Yudin’s Laboratory in a classified research institute (D. Yudin, 
E. Golstein, later A. Ioffe, A. Nemirovskii), Central Economical-Mathe¬ 
matical Institute (E. Golstein, later V. Skokov, N. Tretyakov, Yu. Nes¬ 
terov), Computer Center of the Academy of Sciences (N. Moiseev, 
Yu. Evtushenko, later L. Khachiyan, A. Antipin), other institutes (A. Du- 
bovitskii, A. Miljutin); 

Kiev: Glushkov Institute of Cybernetics (Yu. Ermoliev, B. Pshenichnyj, N. Shor, 

V. Mikhalevich, E. Nurminskii), other institutes (S. Zukhovitskii, R. Po¬ 
lyak, M. Primak); 

Novosibirsk: Institute of Mathematics and Novosibirsk State University (L. Kanto¬ 
rovich, G. Rubinstein, I. Dikin, V. Bulavskii, A. Rubinov, A. Kaplan); 
Leningrad: Leningrad State University (V. Demyanov, I. Romanovskii, A. Vershik). 

Besides these four centers, research activity took place in some provincial towns such 
as Kharkov (Yu. Ljubich, G. Majstrovskii), Sverdlovsk (I. Eremin), Irkutsk (V. Bulatov), 
Minsk (R. Gabasov, F. Kirillova, later B. Mordukhovich), Voronezh (M. Krasnoselskii, 
A. Levin), etc. 


5.3. Main journals 

Publications on mathematical programming appeared in various journals. The main 
journals with their English translations and places of publication are listed below. 

• Zhurn. Vychisl. Matem. i Matem. Fiz. = USSR Journ. Comp. Math, and Math 
Phys., Moscow; a journal on numerical analysis. 

• Kibernetika = Cybernetics, Kiev; a journal on computer science, system theory 
and optimization. 

• Ekonomika i Matematicheskie Metody = Mathecon, Moscow; a journal on math¬ 
ematical economics. 

• Avtomatika i Telemekhanika = Automation and Remote Control, Moscow; a jour¬ 
nal on control. 

• Doklady AN SSSR = Soviet Math. Doklady, Moscow; all branches of science. 
However, we have never had a special journal on mathematical programming! 


5.4. Main events 

The life of the optimization community in the 1960s was full of professional events, to 
name just a few of the most important ones: 
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• Seminars and lecture courses on optimization in Moscow State University, started 
1961,1. Girsanov, V. Tikhomirov, B. Polyak; 

• Seminars and lectures in Kiev, started 1960, S. Zukhovitskii, B. Pshenychnyj. 
N. Shor; 

• International Congress of Mathematicians, Moscow, 1966. At the time this was the 
first contact with Western experts, and so played a significant role in our involvement 
in the international community; 

• Drogobych Winter Schools on Mathematical Programming and Related Topics. 
Chaired by S. Zukhovitskii and held annually since 1968. Some years, there were 
as many as 500(!) participants; 

• Summer Schools on Optimization, chaired by N. Moiseeev, started 1966; 

• All-Union Symposia on Optimal Programming Software, chaired by E. Golstein, 
started 1970; 

• All-Union Conferences on Mathematical Programming', 

• All-Union Symposia on Extremum Problems, started 1963; 

• All-Union Conference on Numerical Analysis, 1965, Moscow, had many sessions 
devoted to optimization problems. 


6. The 1970-80s: new directions 

As I have mentioned above, the period after the 1970s was characterized by a progres¬ 
sive decline of many research areas in the USSR; this had an effect on mathematical 
programming as well. There were many internal reasons for this (specific to the devel¬ 
opment of any science) as well as the general atmosphere of stagnation in Soviet society, 
which played its unavoidable role. In any case, activity of the previous community life 
decreased (fewer meetings on optimization with fewer attendees, fewer new ideas etc.) 
Nevertheless, there were several breakthroughs during this period, and I will mention 
some of them below. 


6.1. Complexity of optimization problems and efficient methods of optimization 

In the series of publications of 1976-1979 (summarized in the monograph [60]), A. Ne- 
mirovskii and D. Yudin introduced a new notion of complexity of optimization prob¬ 
lems. Their approach was as follows. Let us consider a family of optimization problems 
equipped with an oracle, i.e., a certain source of information about one or another par¬ 
ticular element in the family we deal with. For instance, suppose we consider a class 
of smooth, strongly convex unconstrained minimization problems, then the oracle pro¬ 
vides a value of a function to be minimized and its gradient at any point. What are 
the potential abilities of arbitrary methods which exploit this information? Nemirovskii 
and Yudin established lower bounds for various classes of optimization problems. For 
instance, they have found that for the above-mentioned class of strongly convex smooth 
optimization problems, there exists no method which provides a solution with a relative 
error v for less than 0( ffiQ In 1/v) calculations of the gradient, where Q is the ratio 
of the Lipshitz constant for the gradient and the constant of strong convexity. Similar 
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results were obtained for the classes of Lipshitz continuous (multiextremum) problems, 
general convex problems, stochastic optimization problems (where the oracle provides 
a gradient value corrupted by random noise), etc. 

On this way, the authors were able to find effective methods for minimization. Indeed, 
if a method has complexity which coincides by the order with the lower bound, then it 
is the optimal one, i.e., there exists no other method that solves all problems of the class 
in a faster (by the order) way. Note that the notion of complexity in [60] differs from 
the standard asymptotic rate of convergence - it is not an asymptotic property. 

A serious contribution to the theory of efficient methods was made by Yu. Nes¬ 
terov [61]. For instance, he has found the optimal method for minimization of smooth 
convex (but not strongly convex) functions. 


6.2. The method of ellipsoids and polynomial complexity of linear programming 

Above, I have mentioned the “center of gravity” method by A. Levin [48] for the 
minimization of nondifferentiable convex functions. An implementable version of this 
method (where an auxiliary problem of finding the center of gravity of a polytope 
was replaced with the trivial problem of finding the center of an outer ellipsoid) was 
proposed by Yudin and Nemirovskii in 1976 [62] and independently, a year later, by 
N. Shor [63]. Based on this method of ellipsoids, L. Khachyan constructed an iterative 
method for solving linear programming problems which was proven to have polynomial 
complexity [64]. Hence, the question: Whether linear programming problems are NP- 
hard or not, which remained open for a long time, has been resolved. 


6.3. Interior-point polynomial methods and semidefinite programming 

In spite of being solid theoretically from the complexity point of view, the method 
of ellipsoids for linear programming had not become a competitor to the simplex 
method. The true numerical progress is connected with Karmarkar’s method [65]. Fol¬ 
lowing this line of research, Yu. Nesterov and A. Nemirovskii considerably extended 
the approach in the series of papers published in 1987-1989 and summarized later in 
their monograph [66]. They constructed polynomial interior-point methods for various 
classes of convex programming problems. Moreover, they developed general notions 
and techniques {self-concordantfunctions, barriers ) for such an extension. One of their 
significant contributions was the development of semidefinite programming , i.e. op¬ 
timization problems subjected to matrix semidefiniteness constraints. They obtained 
polynomial algorithms for solving such problems based on interior-point methods with 
self-concordant barriers. These pioneering works generated a new area of mathematical 
programming [67]. Moreover, a particular class of semidefinite programming, so-called 
linear matrix inequalities, has found numerous applications in control [68]. 


6.4. Progress in nonconvex and nonsmooth analysis 

The general analysis techniques developed in the 1960s for optimization problems were 
based either on the classical calculus (for smooth problems) or on convex analysis 
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(for nonsmooth convex problems). New types of application required the develop¬ 
ment of more sophisticated tools which have got the name “nonconvex analysis.” One 
of the most successful approaches to nonconvex analysis was proposed by B. Mor- 
dukhovich [69]; it is based on the method of metric approximations. Another way was 
chosen by A. Ioffe (e.g., see [70]); it exploits the extension of the notion of subd¬ 
ifferential to nondifferentiable mappings. Yu. Nesterov [61] elaborated the theory of 
lexicographic differentiation which allowed to obtain calculus of nonsmooth functions. 
E. Levitin systematically studied the theory of perturbations for smooth and nonsmooth 
optimization problems [71], 


7. Conclusion 

I am writing the paper after many dramatic events in our country, such as the collapse 
of the USSR and the end of the communist system. Of course, political and economical 
changes strongly affected the situation with research in Russia. The organization of 
basic research was not modified and looks outdated. The shortage of state funding and 
the lack of support from industry and business unavoidably leads to slow but permanent 
decline of research institutions. Since there are no former obstacles for going abroad, 
many experts choose emigration as a way to resolve their personal problems. Today, 
a minor part of the mathematical programming community remains in the country. Very 
few seminars, conferences, workshops are held in Russia, and researchers face strong 
difficulties in visiting such meetings abroad due to the lack of financing. Last but not 
least, - research does not attract young people any more, and the community is getting 
older. 

Nevertheless, I do not want to finish on such a pessimistic note. I do believe that 
the great traditions of mathematical research in Russia will be able to overcome the 
difficulties, and science will survive... 
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